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THE MEASUREMENT OF ABILITY IN READING 


INTRODUCTION 


1 It is the purpose of this number of the Recorp to report some 
of the results of work toward the construction of scales for the 
measurement of ability to read. The work is being continued 
and a much more satisfactory report will be made later; but 
the need for even rough means of measuring school achievement 
in reading is so pressing, and so many requests have come for 
information about these new scales, that Iam giving now this 
preliminary account of the work, so far as it has gone. 

It is obvious that educational science and educational practice 
alike need more objective, more accurate and more convenient 
measures of (1) a pupil’s ability to pronounce words and sen- 
tences seen; (2) a pupil’s ability to understand the meaning of 
words and sentences seen; (3) a pupil’s ability to appreciate and 
enjoy what we roughly call “ good literature,”’ and (4) a pupil’s 
ability to read orally, clearly and effectively. Any progress 
toward measuring how well a child can read with something of 
the objectivity, precision, commensurability, and convenience 
which characterize our measurements of how tall he is, how much 
he can lift with his back or squeeze with his hand, or how acute 
his vision is, would be of great help in grading, promoting, 
testing the value of methods of teaching and in every other case 
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where we need to know ourselves and to inform others how well 
an individual or a class or a school population can read. 

I have at present no results to offer in the case of scales for 
measuring (3) and (4)—appreciation and elocution, but have 
coéperated with Mr. W. S. Gray in the construction of a first 
rough scale for measuring (1) simple, oral reading of matter-of- 
fact passages, and have devoted much time to scales for (2) 
silent reading so far as concerns (a) the understanding of words 
singly and (b) the understanding of sentences and paragraphs. 

The scale for measuring simple oral reading or the ability to 
pronounce words and sentences seen will be better described 
after the scales for silent reading are understood. I therefore 
begin with the scale for measuring the ability of a pupil to know 
the meanings of single words seen, or, as we may suitably call it, 
the Scale for Extent or Range of Visual Vocabulary. 


ScaLeE A FOR VISUAL VOCABULARY 


The scale to be presented here is, I repeat, preliminary and 
provisional, but I shall for the present describe it and its use as 
if it were in final form, since reservations, criticisms, and the 
description of assumptions would only confuse the reader. 
Later, the nature, defects, and limitations of the scale will be 
stated frankly. 

Suppose then that the members of a certain fifth-grade class 
are to be measured. Each of them is given a printed sheet 
containing the Thorndike Reapinc ScaLe A (shown on the 
next page) and told to ‘‘ Do what it says to do,” after first 
completing a sheet containing the Pretiminary Test (shown 
on page 5). 

Each child’s paper is marked for the number of wrongly 
marked and omitted words in each line. The highest numbered 
line that the child does with one (or no) omission or error* is 
taken as his score or measure. Similarly the highest numbered 
line that the average of a class does with not over one omission 
or error is taken as the measure for the class. 





* Except in the case of line 11, the treatment of which will be described 
ter. 




































The Measurement of Ability in Reading 


THORNDIKE READING SCALE A 
VISUAL VOCABULARY 


Write your name here.............. 0.0... cee eeueee 


Look at each word and write the letter F under every 
word that means a flower. 


Then look at each word again and write the letter A 
under every word that means an animal. 

Then look at each word again and write the letter N 
under every word that means a boy’s name. 

Then look at each word again and write the letter G 
under every word that means a game. 

Then look at each word again and write the letter B 
under every word that means a book. 


Then look at each word again and write the letter T 
under every word like now or then that means some- 
thing to do with time. 


Then look at each word again and write the word 
GOOD under every word that means something 
good to be or do. 


Then look at each word again and write the word 
BAD under every word that means something 
bad to be or do. 


4, camel, samuel, kind, lily, cruel 
5. cowardly, dominoes, kangaroo, pansy, tennis 
6. during, generous, later, modest, rhinoceros 


claude, courteous, isaiah, merciful, reasonable 
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i 8. chrysanthemum, considerate, lynx, prevaricate, 


reuben 


| i 9. ezra, ichabod, ledger, parchesi, preceding 
\M 

i) | 

ih 10. crocus, dahlia, jonquil, opossum, poltroon 
i} 10.5 begonia, equitable, pretentious, renegade, 
| | reprobate 


ti 11. armadillo, iguana, philanthropic 
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PRELIMINARY TEST. VISUAL VOCABULARY 


Look at each word and write the letter F under every 
word that means a flower. 

Then look at each word again and write the letter A 
under every word that means an animal. 

Then look at each word again and write the letter N 
under every word that means a boy’s name. 

Then look at each word again and write the letter T 
under every word like now or then that means some- 
thing to do with time. 

Then look at each word again and write the word 
GOOD under every word that means something 
good to be or do. 

The look at each word again and write the word 
BAD under every word that means something 
bad to be or do. 


cat, dick, rose, now, lion, lazy, honest, fred, 


to-day, buttercup, thief, good, then, tiger, dog, 


clean, daisy, before, tom, steal, yesterday, 





horse, william, wolf, john. 
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For example, five children gave results as follows: 


NUMBER OF OMISSIONS AND Errors IN EAcuH LINE IN THE 
Case oF Five Pupis, C, J, N, R, anp W 


Line 4 5 6 7 8 9 10 10.5 il 

Pupil C 0 0 0 0 t 3 3 4 3 
0 0 0 0 1 1 1 3 2 

sh 0 0 0 1 2 4 4 3 3 
. ae 0 0 0 0 1 2 3 5 3 
a 0 0 0 0. O 0 1 1 0 


We then say that C has ability 8; J has ability 10; N has 
ability 7; R has ability 8; W has ability 104 or 11 or better. 
Considering these five children as a class, we would have, as the 
average number of wrongs plus omissions in lines 4 to 11 in 
order: 


00 0 2 10 2.0 2.4 3.2 (and 2.2 for the three- 
word line 11, or 3.7 for a five-word line of equal difficulty). 


We therefore give this class 8 as a measure. 

The choice of 80 per cent or four out of five correct as a stand- 
ard could, of course, be replaced by 100 per cent or 60 per cent, 
but for reasons which scientific students will know without being 
told, 80 per cent is a better standard. The detailed statistical 
treatment of the results of the use of the scale for a single pupil, 
and for a class or group of classes, of the same grade in a school 
system, will be discussed later. For the present let us continue 
with what the scale shows obviously to common sense, con- 


TABLE I 
THE PERCENTAGES OF WRONGLY MARKED AND OMITTED WorpDs in EACH 
LINE OF THE VISUAL VOCABULARY SCALE A IN THE CASE OF 
Eacu or E1cut Ciasses—A, B, C, D, E, F, G, anp H 


Line 4 Line 5 Line 6 Line 7 Line 8 


Class A 8.3 25.5 30.3 $1.7 66.2 
> 2.1 13.6 39.3 60.7 70.7 
a ”: 3.9 12.8 28.8 41.6 57.6 
= 3.9 11.6 27.1 38.7 57.4 
oe 1.2 7.9 17.6 33.3 49.1 
7 oa 2.9 11.8 24.1 47.0 52.4 
oa 3.8 9.4 11.3 35.6 48.8 
Sie 1.0 3.0 3.0 8.5 24.5 
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sidering first the records, obtained from eight classes, A, B, C, 
D, E, F, G, and H, which are shown in Table I.* 

Table I reads: Class A on the average had 8.3 per cent of 
line 4 wrong or omitted, 25.5 per cent of line 5 wrong or omitted, 
30.3 per cent of line 6 wrong or omitted, and so on. Class A 
goes over the 20 per cent of errors in line 5; Class B goes over 
the 20 per cent of errors (and far over it) in line 6; Class C 
in line 6; Class D in line 6; Class E in line 7; Class F in line 6; 
Class G in line 7; and Class H not till line 8. The ability of 
Class A is roughly 4, more exactly somewhere between 4 and 5. 
If we had words such that Class A could just mark 80 per cent 
correctly, these words would be nearer in difficulty to those of 
line 5 than those of line 4, so that 4.7 or 4.8 would be a fair 
guess. The ability of Class B is very roughly 5, more exactly 
between 5 and 6, and probably nearer 5 than 6, so that 5.3 
would be a fair guess. , The ability of Class C is a trifle higher 
than that of B. The ability of Class D is still higher. Class 
E has an average ability a little above 6. Class F is almost ona 
level with Class D. Class G is between 6 and 7, about haMway. 
Class H has an average ability a little below 8. 

We have thus measures of these classes which are, first, ob- 
jective, or free from the personal judgment of the one using the 
scale. Anybody, using the scale as directed, would get substan- 
tially the same results as anyone else. The measures are, in 
the second place, definite in meaning. Ability 6 means the 
ability to mark correctly 80 per cent of certain definite words. 
When we say that Class H has average ability a little under 8, 
and that Class A has average ability about the same distance 
under 5, we know what 8 and 5 mean. It is also the case, 
third, that the 4, 5, 6, 7, 8, etc., of the scale very probably 
represent degrees of difficulty that are approximately equally 
far apart, so that the difference between 4 and 5 is in a certain 
real and useful sense equal to the difference between 5 and 6, 
and so on. It is also the case, fourth, that in a certain real 





* The records of Table I and also of Table III are not actual results with 
Scale A nor, on the other hand, are they artificially made up. They are 
real results from the use of these words of Scale A, but under somewhat 
different conditions than those of Scale A. So far as the points under dis- 
pe eeanernss they will serve as well as actual results with Scale A 
itself. 
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and useful sense the difference between 8 and 4 very probably 
is somewhere nearly equal to the difterence between 4 and zero 
ability to understand single words, so that we very probably 
have some right to say that the amount of this ability in the 
case of Class H is about twice the amount possessed by the 
average of Class A. 

The measures that we have of these eight classes are not, 
however, very precise. Five words of each grade of difficulty 
are not enough. If the measures were precise the order of the 
eight classes would be the same by any line’s results. The 
discrepancies are not great for lines 5, 6, 7, and 8, as shown in 
Table II; and it is possible, by using the information given by 
all the lines together according to proper statistical methods, 
to get a rather accurate measure of a class even from this one 
five-word scale. Even a one-word scale would give information 


TABLE II 


THe OrpDER oF ABILITY OF EIGHT CLASSES ACCORDING TO 
Wuicu Line or ScaLeE A 1s USED AS THE MEASURE 


By line4 Byline5 Byline6 Byline7 By line8 


Class A 1 1 2 2 2 
-' @ 6 2 1 1 1 
> = 2-3 3 3 4 3 
7 2-3 5 + 5 4 
°* £ 7 7 6 6 6 
a 5 4 5 3 5 
a 4 6 7 6 7 
7 - 8 8 8 8 8 


of some value, as is shown in Table III, which gives the data 
for each single word for the eight classes A, B, C, etc. Class H 
for example, is better than Class A in the case of every word of 
every line. Still it is clear that a ten-word or twenty-word 
scale will be necessary for very precise estimates of the ability 
of a class; and I am now engaged in constructing extensions of 
the scale to that end. 

For measuring a single pupil a five-word scale is much less 
precise. A child who happened to be interested in flowers and 
animals would, for example, have a decided advantage over a 
child who was not so interested, both being measured by Scale 
A. Also a single child’s ability with even these eight sorts of 











TABLE III 
RESULTS OF THORNDIKE ScALE A For VisvaL VocaBULaRY wits E1cut Crassgs, A, B, C, D, E, F, G, ann H 


NUMBBR OF WRONG RESPONSES BY SINGLE WorpDs 








Line 5 Line 6 Line 7 Line 8 Line 9 Line 10 Line 10.5 Line 11 


Line 4 
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oidosyjuepiyd 
euen3: 
oyipeunze 


aeqosdes 
apesauaz 
snonusjeid 
arqeainbe 


uoonjod 
uinssodo 


Tmbuof 


Surpeseid 


J23pa} 
Poqeyqs1 
eiza 


uaqnas 
a7es1eAIId 
xu] 
2}eJepisu0D 
winweyjueshry> 


ARHABARR 
RAARRRKA 
AALRARRA 


ARALRBRK 
ARKRNKSRA 
RSRRAKAK 
RRRARRBRA 
RRRARNARV 


RRNGHBRX 
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SRRGNALES 
ARAHLAX 

SSEREREN 
NRANARA 
SRLAKNLS 
HAVIN! 
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LaLAAENe 
egangese 
BaeezRe* 
S2°QrALS 
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words cannot be exactly located by this series of five-word lines, 
For example, we may find records like the following: 


NUMBER OF WRONGLY MARKED AND OMITTED Worps IN EAcu 
Line By Eacu oF Five Pupmus, A, B, C, D, anp E 


Line + 5 6 7 8 9 10 10.5 il 
Pupil A 0 0 0 0 2 0 3 4 1 
~ <a 0 1 0 0 0 2 1 1 3 

we 0 0 0 0 2 0 5 3 2 
ie 0 1 0 1 1 0 0 4 3 

° @ 0 0 0 1 2 0 3 5 2 


Shall we call A’s ability 7 or 9? Shall we call B’s ability 8 
or 10.5? Shall we call C’s ability 7 or 9? Shall we call D’s 
ability 10, disregarding the fact that he has made errors as far 
back as 5 and 7? Shall we call E’s ability 7 or 9? With so 
few words in a line as five, it will often happen, as here with A, 
B, C, and E, that a single pupil will do better with some line 
than he did with its preceding and easier lines; or that other 
irregularities make the use of the highest line done with 0 or 1 
error seem untrustworthy as a measure for the individual. In 
a class the chance special familiarity of one pupil with a given 
line will tend to be counterbalanced by the chance special 
unfamiliarity of some other pupil, so that for a class average 
reversals of the order of the percentages of errors almost never 
occur, but with a single pupil they occur perhaps once in five 
times. We can, it is true, use the pupil’s score in the other 
lines to form a reasonable rough estimate for him. Thus, in 
the cases above, we might call A’s ability 8; B’s, 10; C’s, 9; 
D’s, 10; and E’s, 9. And by a proper set of rules this can be 
done without introducing personal caprice. Samples of the 
records that will be obtained by such provisional use of Scale A 
for the individual pupils in a class are given in Table IV and Table 
V.* These tables show that the five-word scale is adequate to 
detect large individual differences within a class and to measure 





* These records of Tables IV and V are not actual results with Scale A, 
nor, on the other hand, are they artificially made up. They are real results, 
but from the use of these words under somewhat different conditions than 
those of Scale A. So far as the points under discussion are concerned, they 
will serve as well as actual results with Scale A would. 


TABLE Iv 








Spats O = armitted 
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aidosyjueriqd 
euenzi 


Line 11 


oyipeusze 


aeqoida1 
apezsuel 
snorjua}eid 
aqqeyinba 
BIu03eq 


Line 10.5 


uoo1}od 
unssodo 
qinbuof 
eyyep 
$n2019 


Line 10 


Sutpeseid 
tsaqosed 


Line 9 
5 
E 


uaqna: 
a7eoLeAl1d 
xuA] 


Line 8 


9}e1IpIsuod 
wnweyjuesfiy> 


ajqeuoseal 


TABLE Iv 


Tue RESULTs OF USING THE VISUAL VOCABULARY SCALE A WITH A CLAss oF 40 Puptts, 1, 2, 3,4, 5, ETC. x == wrongly marked; 0 = omitted 


[ny1os8ur 
yerest 
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apneyo 
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TABLE V 
Sum OF WRONGLY MARKED AND OMITTED Worps ror EAcs Line or Scare 
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them roughly if interpreted with common sense. But obviously 


we should use the five-word scale to compare individual pupils 
or to measure an individual’s progress only until a more extended 


scale is provided. 

















The Measurement of Ability in Reading 


THE ADMINISTRATION OF SCALE A FOR VISUAL 
VOCABULARY 


Scale A is designed for classes of grades 4 to 8, inclusive, 
but may be used in grade 3, and is useful in the high-school to 
some extent. Fifty people can be measured at once. All that 
is required is that they should understand the general nature 
of the test, and should not be allowed to cheat. The former 
requirement is satisfied by means of the preliminary test shown 
on page 5. While this preliminary test is being taken the 
teacher should go about the class, and make sure that each pupil 
understands the general nature of the work. When the test is 
used in grades 4 and 3, this may require fifteen or twenty minutes 
of the teacher’s time. In grades above 4, there will be very few 
pupils who will not, unassisted, get the idea. In any case, a 
pupil who has less then five errors and omissions in the first 
two lines (together) of the preliminary test, may be assumed to 
understand the general nature of the test. A pupil in grade 3 
or above who has over ten words wrong or omitted in these two 
lines may be assumed not to understand the general nature of 
the test, and should receive special explanation with line 1, until 
he can independently do lines 2 and 3 with not over 6 words 
wrong or omitted, or until the teacher is convinced that he 
does not know the meanings of these printed words—cannot 
read them. In the latter case his ability is under 4 and there is 
no use in testing him with Scale A. 

Cheating can be prevented by ordinary means, and by having 
the test-sheets handed in when the pupil has done his best, 
thus getting the test-sheets of the more gifted pupils out of 
reach of the others as early as possible. As a matter of fact, the 
location of a word and the recognition of the letter written under 
it is difficult at even a short distance, so that the prevention of 
cheating is probably easier here than in the ordinary examination. 

The Scale A sheets should be given out with no further or 
other instructions than, ‘‘ Read what it says. Do what it tells 
you todo. Do your best. Hand in your paper when you have 
marked all the words that you know.”’ Make a note of - time 
when the sheets are given out. 

When a pupil hands in his paper the teacher should sities 


) 


68 a PS 
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whether every word in line 4 is marked (whether rightly or 
wrongly marked is indifferent). If any word in line 4 is yp- 
marked, the teacher should examine the paper to see if the pupil 
has left out the T’s, Good’s or Bad’s entirely. If so, return his 
paper, calling attention to what remains to be done. Other- 
wise, take the pupil’s sheet, being sure that his name is written 
on it, and record the time at which you receive it. 

There will be a wide variation in the time required for pupils 
to finish. Pupils who finish the sheet should be told to study 
quietly. Half an hour should be allowed for the tests in grade 4; 
25 minutes in grades 5 and 6; and 20 minutes in grades 7 and 8. 
Some pupils will finish long before that. A few may require 
more time. Special means may be used to get the measures of 
these last cases. 

The time-record is not used in the measurement of vocabulary- 
range itself, but will prove instructive as a separate fact, and 
requires practically no labor. The pupils should be kept 
unaware of the fact that a time-record is being taken. 

The scoring of the test-sheets can be done rapidly by means 
of a sheet of pasteboard, cut with strips to fit the lines and marked 
with the appropriate letters in the appropriate places. The 
strips being fitted over the words, the scorer can see at a glance 
the number of ‘‘ wrongs ’”’ and omissions in a line and enter it 
at the right-hand margin. 

When scored the results should be entered in a table like Table 
VI, the names being arranged alphabetically for easy reference. 

The work of scoring may be economized by omitting the scor- 
ing and entering of lines which will not figure in the determina- 
tion of the ‘‘ 80 per cent right point.’”’ Thus, for an eighth- 
grade class, lines 4, 5, and 6 may almost certainly be neglected; 
for a fourth-grade class lines 10, 10.5 and 11 may almost certainly 
be neglected. A little experience will teach the scorer what 
lines he needs to score for a given class. What is needed, is the 
line whose percentage of error and omissions is closest to 20, 
the line next above, and the line next below it. 

Attention has already been called to the fact that when the 
percentage of errors and omissions for a given line or degree of 
difficulty, say 6, is known, we can estimate what degree of diffi- 
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TABLE VI 
SAMPLE ScorRING SHEET 


Results of Thorndike Visual Vocabulary Scale A. 
Number of wrongly marked and omitted words in each line for each pupil. 





Name 41/56; 7) 8 | 9 | 10 |10.5) 11 

































































culty would give a percentage of exactly 20 for the class in ques- 
tion. The validity of such processes of estimating depends 
upon certain hypotheses that would be within the interest and 
knowledge of few save special students of educational measure- 
ments. I will not discuss these—nor attempt to tell how 
probable it is that they are applicable in the case of this scale. 
For all practical purposes of teachers and supervisory officers 
it is sufficient to state that the measure obtained by the following 
process of estimating will be somewhere near the truth and will 
on the average probably be nearer the truth than the measure 
got by any other one way that they would themselves devise. 

The process is as follows: 

A. If for any lines the class has a percentage of errors and 
omissions between 16 and 25, estimate the degree of difficulty 
which would give a percentage of 20 as follows: 
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For 15.0 add 49 to the line-number. 
. ie * oe - 
> aoe (9 _ * . S 
eee. * me..* e - 
, Be: * _ ..* . . 


For 21.0 subtract .09 from the line-number. 
“ 


“ 22.0 ” Wee 
“ 23.0 . wa" 
“ 24.0 ”_ ae ™ 
“© BS a 


A full table for any first-decimal value from 16 to 24 is given 


as Table VII. 


B. If there is no line with a percentage of between 15 and 
25, choose the two consecutive lines, the sum of whose percentages 
is nearest 40, estimate separately from each of these two per- 
eentages, using the scheme below or, in detail, Tables VIII and 


IX, and average the results. 


For 8 add 
- oe i = 
, aa a * 
° a se * 
° a.* is“ 
- o * — 
a ; ie 
For 
- . 57 . 
. 2 : 65 " 
« 29 “4 72 . 
” = - i 
"a . 87 - 
° Zz . _— 
° Ss . —_— 
° & ” 1.07 . 
: ad aa * 
° = . 1.21 - 
° 2 — 
°s as im * 
“ “ “ 


39 


1.41 





“ 


> 2 eo. eB 


“ 


oa ee ee ee oe a a 


“ 


S a eee 





“ “ “ 
“ “ “ 
“ 


1.41 to the line-number. 


26 subtract .50 from the line-number. 
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16. 


17. 


18. 


19. 
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Add to 
line number 


.49 
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For ESTIMATING THE DEGREE OF DiFFICULTY REQUIRED TO Propuce 20 
PER CENT OF WRONGLY MARKED AND OmITTED Worps, WHEN A GIVEN 
LINE OF SCALE A PRODUCES FROM 15 To 25 PER CENT oF SUCH 


Subtract from 
line number 
.00 
.00 
.01 
.02 
.03 
.04 
.05 


.07 


20.0 


21. 


22 


23. 


24. 


SOD NAN RW OO DUAU RW OOCHUAUR WHO OCDUAUR WANE OOCDUIAUR WN 


N 
mn 
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TABLE VIII 
For Use 1n ESTIMATING THE DEGREE OF DIFFICULTY REQUIRED TO Pgo- 


pucE 20 Per CENT OF WRONGLY MARKED AND OMITTED Worps 





> fe De ee Me: Sat, ae ee ee “eh “ee Se Se ee ee et Se Ses ek Set at ee et ek ee ee ce Se es Ste my vo A ee le eo ee oe SO PP ee Oe. 
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3 
n 


op! pe Se. Pe kt Day Se ber, Se Bo, GR ek Ot “Da ee “ee “ee ee ee i et ae ee ee a a re ee a tO lk 


*” be ~” * 
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rt NN OH HINO ee ~ HN HINMOMmMm 
§ araveseseganagaays SEIBBSBSE SNRSRLEKEKR 
3 
” 
w oOo ~ iv?) nN 
N N N N N 
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TABLE Ix 


For Use 1n EsTIMATING THE DEGREE OF DiFFICULTY REQUIRED TO Pro- 
pucE 20 Per CENT OF WRONGLY MARKED AND OMITTED Worps 


Add Add Add 
8.0 1.41 11.0 .96 13.0 .71 
1 1.39 1 9 » Ga 
2 1.37 2 .94 2 .69 
3 1.36 3 .92 3 .68 
4 1.34 4 .91 4 .66 
-§ 1.32 5 .90 S$ .6§ 
6 1.31 6 .88 6 .64 
7 1.29 7 «87 7 .63 
.8 1.28 8 .86 8 .62 
9 1.26 9 .& ae 
9.0 1.25 12.0 .83 14.0 .61 
1 1.23 i .82 .. <a 
2 1.22 2 «81 2 .58 
-3 1.20 3 .80 3 .S7 
4 1.19 4 .78 4 .56 
-_ 5.59 S$ .7 S$ .35 
-6 1.16 6 .76 6 .53 
7 1.14 7 «.75 ? oe 
8 1.12 8 .74 8 .51 
9 1.11 9 .72 9 .50 
10.0 1.10 
-1 1.08 
2 1.06 
-3 1.05 
4 1.04 
-5 1.03 
6 1.01 
.7 1.00 
- wo 
7 


The time required to measure a class of 40 pupils, record the 
results, and estimate the degree of difficulty that would give a 
percentage of 20 for errors and omissions, will vary from two to 
five hours, according to the skill of the measurer, and the clear- 
ness of the pupil’s writing and the chance constitution of the 
class. It would seem to be well worth while for every school 
to make such a measurement at the beginning and end of 
the school year in grades 4 to 8. 


LIMITATIONS AND DeErFeEcts oF ScALE A 


The insufficient precision of the scale has already been noted, 
and the remedy, its extension by the use of other words of equal 
difficulty for each line. The task of finding other names of 
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flowers, animals, etc., etc., just as hard for children in grades 4 
to 8 to read (well enough to mark them correctly in the test) as 
are, say, chrysanthemum, considerate, lynx, prevaricate and 
reuben, is a very long one. The task of constructing other 
graded series equivalent to lines 4, 5, 6, etc., of Scale A in diffi- 
culty, but with different sorts of words (say, colors, words about 
ships, words about war, words that mean distance, etc., etc.) is 
a still longer one. I am making such progress as I can with 
both of these tasks. 

There is a special limitation to Scale A in that the very im- 
portant prepositions, pronouns, conjunctions, auxiliary verbs 
and other words expressing relations do not figure in it. It is 
also, in general, hard to get these words into any scale made on 
the ‘‘ checking by classes’ principle. This limitation is not so 
serious as appears at first sight, for the chief importance of these 
words is as clues in sentence comprehension, and our scale for 
understanding the meaning of sentences and paragraphs, to be 
described later, tests knowledge of them rather thoroughly. 

The scale, even when properly administered, will occasionally 
measure a mixture of general stupidity or indolence or mischief 
with inability to understand words. Probably no scale could be 
objective and convenient in use without suffering from this 
limitation. 

The scale does not measure ability to understand the meaning 
of these printed words in general, or, as they come in ordinary 
texts, or completely, but only to understand them well enough to 
classify them as required by the test. This limitation is, however, 
a very, very desirable one. ‘“‘ To be able to read during” or 
“to understand the meaning of poltroon ”’ is altogether too vague 
a statement for scientific use. What degree of understanding 
we require in our test is of almost no consequence, but that we 
should define objectively the degree of understanding that we 
do require is of very great importance. The scale does this 
admirably. The same general plan of test can also easily be 
adapted to very, very thorough knowledge of words and very, 
very fine discriminations between them. 

A pupil has one chance in eight of being right by a mere 
guess. A chance of one or more in twelve is necessary for any 
workable test of this ‘‘ checking by classes’ type and when we 
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are concerned, as here, with the 20 per cent of error point, the 
small admixture of chance does little harm. It would be best 
theoretically to force guessing, making every pupil mark every 
word in some way, but for practical reasons I have decided 
against that method of administering the test. It seems probable 
that a school where guessing was encouraged would suffer as 
much by the resulting carelessness as it would gain by the 
chance successes. It is well to score omissions and “‘ wrongs ”’ 
separately. Of two schools with equal percentages of the two 
combined the school with more omissions would be slightly 
superior in word-knowledge. 

The words on any one line are not of exactly equal difficulty. 
The differences are, however, not large enough to constitute a 
defect of practical importance. 

The differences in difficulty between successive lines are not 
exactly equal, and their approximate equality depends upon the 
approximate truth of certain hypotheses about the distribution of 
word-knowledge in children of the same grade and about the 
comparative variability of the children in grades 4, 5, 6, 7 and 8 
in respect to word-knowledge. For practical purposes, however, 
the use of the scale at its face-value will surely do little harm, 
and will probably do less harm than any other choice of values 
that the reader might feel inclined to make. 


Some SpEcIAL ADVANTAGES OF SCALE A 

The scale measures ability to understand printed words, 
unconfused with ability to express oneself orally or in writing. 
Checking by classes is in this respect far superior to any form of 
definition test. 

The test sheet forms the permanent record of the measurement 
so that thousands of measurements can be taken on one day and 
scored at leisure. The scoring can be done by unskilled labor. 

The scale, when extended to include harder words, forms a 
means of measuring achievement and improvement from the 
third grade on through high school or college. 

The scale can be applied in principle absolutely, and in con- 
crete detail with slight modifications, to the measurement of 
extent of vocabulary in any foreign language. Such scales for 
French, German and Latin are being planned. We shall with 


_ - a + __—_—— 
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them not only be able to define the word-knowledge of a pupil, 
or class, but also to state it in terms of a standard attainment 
with the vernacular. For example, we shall be able to state 
that a given second-year class in German knew printed German 
words as well as an average third-grade pupil knows printed 
English words. 

The scale can be increased by alternative series to any extent, 
so that dishonest special training on the scale-words can be made 
ineffective. 

THE DERIVATION OF SCALE A 

The words of the scale were chosen from a much larger number 
which were given to about 2,500 pupils in grades 4, 5, 6, 7, and 
8, of five different schools, in the form of Tests I, II, III, and IV, 
shown below, in April, May and June. 


I 


Write the letter c under every word that means a 
color. Write the letter m under every word that 
means a thing that makes music. Write the letter w 
under every word that means some thing that boys 
or girls wear. Write the letter d under every word 
that means some thing that a boy can do. 


Remember— c, for colors 
m, for things that make music 
w, for things to wear 
d, for things boys can do 


red, green, guitar, hat, coat, run, work, play, shoe, 
jump, hide, piano, pink, cuff, shout, study, organ, 
reach, yellow, grasp, scream, collar, request, shiver, 
crawl, shirt, violin, violet, disagree, purple, inquire, 
scarlet, harp, flute, trumpet, practice, ramble, 
crimson, cornet, apron, mandolin, trespass, 
prevaricate, sweater, confess, ribbons. 


II 


Write the letter a under every word that is the 
name of an animal. Write the letter t under every 
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word that means a kind of tree or wood. Write the | 
letter b under every word that means some kind of } 
a book. Write the letter g under every word that ) 
means some kind of a game. | 


Remember— a, for animals 
t, for tree 
b, for books 
@, for games 


lion, tiger, pine, bible, oak, base-ball, primer, tag, | 
deer, maple, snake, elm, willow, walrus, leopard, | 
jack-straws, birch, tennis, giraffe, hickory, elephant, 
kangaroo, dictionary, dominoes, hemlock, croquet, 
gorilla, golf, novel, mahogany, walnut, encyclopedia, 
ledger, rhinoceros, parchesi, cypress. 


Ill 


Write a letter g under every word that means | 
something good for a boy or girl to be. Write a letter 
b under every word that means something bad to be. 
Write a letter s under every word that means some- | 
thing to do with school. Write a letter t under every ; 
word like “now” or “when” or “before” that means 
something to do with time. | 

Remember— @Q, for good things | 

b, for bad things i] 


s, for words about school 
t, for words about time 


liar, fair, lesson, then, lazy, steal, teacher, honest, 
clean, kind, never, writing, sneak, reading, polite, 
before, useful, stingy, murder, spelling, arithmetic, 
cowardly, cruel, afterward, whenever, truthful, 
modest, upright, geography, graduate, recess, rascal, 
drunkard, obliging, later, deceitful, during, scoundrel, 
promotion, grade, generous, criminal, torture, loyal, 
history, miser, reprobate, earlier, courteous, 
penmanship, merciful, forger, courageous, craven, 
renegade, poltroon, reasonable, examination, 
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considerate, deportment, discipline, defaulter, 
equitable, sycophant, preceding, philanthropic, 
hitherto, grammar, etymology, pretentious, courteous. 


IV 


Write a letter nm under every word that means 
some boy’s name. Write a letter a under every word 
that means some animal. Write a letter f under 
every word that means some flower. Write a letter 
w under every word like “lawyer” or “engineer” or 
“salesman”’ that tells what a man’s work or occupa- 
tion is. 


Remember— n, for boys’ names 
a, for animals 
f, for flowers 

w, for occupations 


John, Dick, Cat, Dog, Doctor, Rose, Teacher, Horse, 
Baker, Wolf, Daisy, Lily, Fred, Farmer, Monkey, 
Violet, Bear, Grocer, Tom, Elephant, Butter-cup, 
William, Peter, George, Camel, Clover, Samuel, 
Pansy, Blacksmith, Tulip, Carpenter, Paul, Edward, 
Mason, Painter, Leopard, Lilac, Tailor, Banker, 
Michael, Raccoon, Crocus, Geranium, Hiram, Plumber, 
Lizard, Hyacinth, Reuben, Claude, Giraffe, Lynx, 
Chrysanthemum, Joshua, Druggist, Peddler, Begonia, 
Zebra, Fuschia, Nathaniel, Wheelwright, Sloth, 
Rhinoceros, Kangaroo, Dahlia, Ezra, Broker, Orchid, 
Electrician, Heliotrope, Contractor, Ichabod, Opossum, 
Isaiah, Armadillo, Nasturtium, Iguana, Jonquil, 
Ulysses, Stenographer, Stevedore. 


The criterion of approximately equal difficulty was that ap- 
proximately equal percentages of pupils in each of grades 5, 6, 7, 
and 8 should mark the word correctly in these tests. How close 
the approximation is may be seen in Table X, which gives the 
percentages correctly marked in these grades for each word of 
the Scale A. It is, of course, true that classifying these words 
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TABLE X | 
Resutts or Tests I, II, III, anp IV, as Given To AppROXI- 
MATELY 500 Pupits In Eacu oF Grapes 5, 6, 7, AND 8 
Percentages correct 
Word 
8th grade 7th grade 6th grade 5th grade 
re 100.0 99.3 98.4 96.4 
IRS dias Ses 99.6 99.3 98.6 96.6 
See 99.1 98.2 96.7 95.9 
lily.. 98.5 98.4 97.9 96.2 
IS 99.6 99.3 99.3 96.8 
cowardly ..... 99.3 98.6 98.1 92.5 
dominoes...... 98.5 97.2 94.1 87.2 
kangaroo...... 99.5 98.4 95.2 89.4 
MING 5 ceva ie 97.7 97.7 96.8 90.6 
a 98.3 95.4 95.9 90.2 
Pe 95.5 95.4 91.1 77.3 
generous....... 99.1 96.6 92.8 76.8 
See 96.2 95.8 92.6 80.2 
a 93.7 93.6 87.8 77.1 
rhinoceros ..... 98.5 96.5 90.6 81.7 
ae 94.2 90.8 80.3 61.0 } 
courteous...... 97.6 94.0 88.5 62.4 
ae 88.1 90.3 77.6 60.5 
merciful....... 93.7 86.0 81.9 61.1 
| reasonable..... 95.1 90.8 85.4 65.5 
chrysanthemum 86 6 76.6 70.6 50.9 | 
considerate... . 90.6 82.1 71.7 44.3 ) 
gine a: 4-2 86.1 76.3 65.3 51.4 | 
prevaricate.... 88.4 81.4 73.7 52.9 
reuben......... 84.8 80.5 70.4 47.3 
aw ndlix Bis 71.3 65.1 52.6 32.3 
ichabod ....... 80.0 78.4 51.9 27.4 
eee 82.7 73.5 50.2 41.1 
parchesi....... 71.1 61.9 50.9 37.6 
preceding...... 79.1 69.9 45.7 34.1 
ees.......:. Be $1.3 43.5 31.4 
Pixie tavas 61.5 52.6 44.9 32.3 
ee 53.7 44.2 39.1 33.2 
opossum....... 52.4 46.2 39.3 23.3 
poltroon...... 61.2 53.8 42.1 24.0 
DOSMEB......62% 50.9 45.3 36.3 22.7 
equitable...... 51.7 48.7 40.9 20.5 
pretentious. ... 47.0 39.6 30.4 23.4 
renegade....... 51.0 40.9 23.4 18.0 
reprobate...... 46.7 44.1 32.8 19.8 
armadillo...... 40.1 38.9 41.4 20.4 
OS 38.7 35.8 30.1 13.7 
philanthropic .. 42.0 30.1 22.4 17.7 
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under the conditions of Scale A may give somewhat different 
relative difficulties from those obtained with the words under 
the conditions of Tests I, II, III, and IV. This can be deter- 
mined by experiment and the Scale can be amended if necessary, 
It is also the case that the large percentage of Jewish children 
in the schools at my disposal may have given values for the proper 
names that will need to be amended after wider use. As was 
stated at the beginning, this report is preliminary and provisional, 
and is made now only because the scale, though imperfect, is 
very much needed, and because the best way to improve it is 
through the information gained by using it. 


MEANS OF IMPROVING THE SCALE 


The extension of Scale A to a ten-word scale is a matter of 
time and labor. By using a test identical with the scale except 
that many other words not in Tests I, II, III and IV are added 
(e.g., as boys’ names, Frank, Joseph, Richard, Walter, Edgar, 
Jacob, Malachi, Nehemiah, Matthew, Luke, Levi, Leo, Ivan, 
Jacopo, Petro, Eric, Edmond, Augustus, Nicholas, and the like), 
we shall find certain words equal in difficulty to those of some of 
the standard lines. 

The first alternative scale now planned is for checking for 

Parts of the body, 

Tools, 

Words about the sea and ships, 

Parts of a house, 

Words about church and religion, 
Words about war and fighting. 

Words about business and money, 
Words about relatives and the family. 

Tests VIII and IX will be given to about 2,500 pupils in grades 
5, 6, 7, and 8 and such further studies made as become neces- 
sary. Another alternative scale will be worked out from results 
obtained from Tests XI, XII, and XIII. Words of difficulty 
11.5, 12 and 12.5 will be sought also. 

Words of difficulty 4.5, 5.5, 6.5, 7.5, 8.5 and 9.5 will be selected 
from the material now on hand and to be obtained this year, so 
as to increase the exactitude of the measurement of a class or 
individual. 
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Vill 


Write a letter b under every word that means some 
part of the body. Write a letter t under every word 
that is the name of a tool. Write a letter s under every 
word that means something to do with the sea or 
ships. Write a letter h under every word that means 
some part of a house. 


Remember— b, for parts of the body 
t, for tools 
8, for words about the sea and ships 
h, for parts of a house 


arms, ear, wave, door, eye, ship, hall, saw, bone, sail, 
hammer, wall, ocean, face, deck, window, axe, float, 
mast, chamber, foam, file, canoe, billow, cellar, knife, 
harbor, elbow, coast, attic, brain, bosom, basement, 
breast, launch, artery, chisel, shin, ceiling, brace, 
tongue, helm, garret, porch, gulf, kitchen, hatchet, 
fleet, balcony, gimlet, channel, casement, cargo, entry, 
cruise, embark, chimney, thigh, tiller, awl, alcove, 
ell, keel, piazza, cleaver, spine, screw-driver, dormer, 
bevel, cartilage, rudder, corridor, eaves, ratchet, 
kidney, hurricane, gable, lathe, cerebellum, lagoon, 
plane, mallet, leeward, hearth, vise, cranium, nautical, 
wainscot, adze, ligament, cornea, augur, navigable, 
patella, starboard, lymph, mariner, peritoneum, hull, 
jetty. 
IX 

Write a letter c under every word that means 
something about churches or religion. Write a letter 
w under every word about war or fighting. Write a 
letter b under every word about business or money. 


Write a letter r under every word like father, son, 
wife, about relatives or the family. 


Remember— c, for words about church and religion 
w, for words about war and fighting 
b, for words about business and money 
r, for words about relatives and the family 
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fight, brother, priest, pay, bottle, sister, buy, camp, 
flag, mother, money, defend, pray, sell, hymn, gun, 
father, captain, firm, owe, defeat, fort, aunt, merchant, 
cannon, conquer, tax, flank, psalm, finance, fortress, 
invest, bishop, monk, uncle, profit, creed, interest, 
guard, convent, nephew, freight, general, orphan, 
dagger, income, troops, marriage, worship, ownership, 
chaplain, nun, cousin, lease, colonel, abbott, niece, 
captive, altar, relative, military, insolvent, infantry, 
catholic, fortification, baptism, descendant, purchase, 
offspring, invader, indorse, commander, adoption, 
brigade, battery, curate, generation, cartridge, kinsfolk, 
blockade, cardinal, divorce, strategy, guarantee, 
garrison, rebate, buckler, catechism, installment, 
canonical, sentinel, forgery, citadel, patent, campaign, 
mortgage, cavalry, cloister, kinship, insurance, 
ordnance, episcopacy, genealogy, corporal, rampart, 
ecclesiastical, lieutenant, progenitor, friar, bulwark, 
indemnity, entrenchment, litigation, manoeuver, 
recruit, penitential, lineal, halberd, pontifical, adjutant, 
protestantism, legatee, monasticism, ammunition, 
negotiable, belligerent, peculation, canteen, chancel, 
monachism. 


XI 


Look at each word. Think what it means. If it 
means a bird, write a letter b under it. If it means 
a fish write fi under it. If it means an insect, like 
fly, or ant, or bee, write a letter i under it. If it means 
a four-legged animal, like cat or dog or horse, write a 
figure 4 under it. 


Remember— b, for birds 
fi, for fishes 
i, for insects, like fly or ant or bee 
4, for four-legged animals, like cat or dog 
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cow, dog, cod, ant, bear, robin, moth, lark, swallow, 
grasshopper, calf, fox, owl, wasp, boar, sparrow, 
donkey, goldfinch, camel, canary, shark, parrot, perch, 
hornet, thrush, raven, minnow, bullock, pigeon, goat, 
monkey, eagle, mule, cuckoo, trout, hawk, gull, 
herring, partridge, pike, grouse, smelt, buffalo, lice, 
giraffe, rhinoceros, bobolink, shad, beetle, panther, 
chickadee, halibut, flea, vulture, pickerel, mosquito, 
loon, quail, mackerel, locust, wren, stag, salmon, cricket, 
elephant, auk, flounder, kangaroo, termites, cockroach, 
plover, haddock, katydid, caribou, sardine, chamois, 
bittern, beagle, gibbon, coot, mullet, midge, lynx, 
oriole, gnat, tapir, curlew, pheasant, sloth, sturgeon, 
gazelle, cormorant, jackal, porcupine, snipe, carp, 
weevil, peccary, turbot, shrike, scorpion, cockchafer, 
aphis, flamingo. 


XII 


Look at each word. Think what it means. If it 
means something a boy can do with his feet and legs, 
write a letter f under it. If it means something a boy 
can do with his arms and hands, write a under it. If 
it means something a boy can do with his eyes, write 
e under it. If it means something a boy can do with 
his mouth and throat, write m under it. 


Remember— f, for things done with feet and legs, like run, jump, kick 
a, for things done with arms and hands, like pull, take, reach 
e, for things done with eyes, like see, look, read 
m, for things done with mouth and throat, like cry, talk, drink 


kick, fold, step, hug, walk, read, reach, gaze, pull, 
wink, hop, dance, grasp, laugh, rub, leap, shake, 
roar, stand, grip, hurrah, wade, hurl, watch, skate, 
gather, skip, glare, seize, howl, plod, moan, sign, 
gasp, limp, stab, mourn, throw, slip, stare, trip, scowl, 
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write, hoot, scrub, observe, grin, patter, punch, gape, 
stamp, glance, recite, mock, prance, scour, groan, jeer, 
perceive, chirp, snatch, grumble, chant, blink, croak, 
glower, stumble, nibble, juggle, gargle, trample, scrawl, 
jabber, waltz, screech, twist, scuffle, pulverize, grunt, 
peer, pedal, gulp, pluck, murmur, twinkle, trudge, 
gurgle, scourge, scrutinize, halloa, pirouette, quaver, 
tread, throttle, waddle, pronounce,’ regurgitate, 
implore, shamble, clamor, hum, smite, whimper, prate. 


XIII 


Look at each word. Think what it means. If it 
means a color like red or blue, write a letter c under it. 
If it means something about number, like six, all, half, 
many, write n under it. If it means something about 
time, like now, late, when, never, write t under it. If 
it means something about direction or location, if it 
is a word like easi, north, up, down, above, behind, 
write d under it. 


Remember— c, for words about color, like red, blue, green 
n, for words about number, like more, five, many 
t, for words about time, like then, often, early 
d, for —_ about direction and location, like front, east, 
Te 


last, west, here, half, early, brown, many, below, 
there, month, across, year, noon, back, forty, gray, 
first, right, pair, left, green, morning, whole, pink, 
while, where, afternoon, minute, gold, edge, soon, 
outside, some, more, evening, plum, inside, beneath, 
odd, even, every, yellow, monday, toward, dozen, 
june, group, future, buff, from, count, nine, forenoon, 
purple, middle, plural, tuesday, instant, couple, score, 
crimson, april, each, during, interior, forward, 
wednesday, never, december, singular, center, hazel, 
outward, several, scarlet, violet, double, frequent, 
chestnut, august, ruby, either, rarely, recent, overhead, 
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million, tan, exterior, quartet, seldom, tawny, olive, 
january, margin, numerous, immediate, bounding, 
february, encircling, september, lilac, numeral, crowd, 
gradual, roan, quadruple, opposite, minority, 
november, russet, diagonal, october, faun, formerly, 
garnet, overhanging, multitudinous, lasting, meantime, 
duplicate, continue, intervening, perpendicular, 
henceforth, elevated, lavender, forthwith, sextet, 
incessant, azure, surmounting, majority, previous, 
interim, thereabouts, plurality, narrow, perennial, 
frontal, treble, repeatedly, constantly, carmine, 
neighboring, parallel, contemporary, vertical, mauve, 
decade, emerald, magenta, octile, ecru, contiguous, 
quintet, ensuing, horizontal, evanescent, sepia, 
conterminous, multiple, integer, vermillion, eternal, 
turquoise, transverse, century, sexagesimal, ephemeral. 
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A ScALE FOR MEASURING THE UNDERSTANDING OF SENTENCES 
AND PARAGRAPHS 


Mere word knowledge is much less important than the ability 
to get the message carried by a continuous passage. Competent 
judges would rate the latter as from sixty to ninety per cent of 
the total result to be sought by the elementary school in the 
teaching of reading. Probably no other one scale for educa- 
tional measurements is so important as a scale for measuring 
the understanding of sentences and paragraphs. 

The desiderata of such a scale are, of course, the general 
desiderata of objectivity, definiteness, exactitude, convenience, 
and commensurability. The special difficulties in this case are 
to measure ability to understand unmixed with ability to ex- 
press and to do so without ambiguity and at small time-cost. 
I have experimented along two lines,—with tests like A, B, 
C, D, E, and F below, and with tests like V, VI, and X. 


A 


Read this and then write the answers to 1, 2, 3, 4, 
5, 6, 7, and 8. Read it again as often as you need to. 


Tom gave a gray cat to Mary. She gave him a 
black dog. 


ere e eee eee eee eee enw nne 
Swreseecoueeeseenoesn42+d Oe 
Pweeeoseconoeewn ene 02e0 6 6s ¢ 412422 


wPeeseneveedcse eevee eee ean ens £8 Oa 


Setar aeeeena ree ss 


1 
2 
3 
4 
eS er rrr 
6 
7 
8 


Seacoast esenesovsvessnene eee 
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3, 


B 


Read this and then write the answers to 1, 2, 3, 4, 
6, 7, and 8. Read it again as often as you need to. 


John had two cents. Tom had four cents. Will had 


six cents. Mary had ten cents. 


ee aE Se le Uwe 


3, 


C 


Read this and then write the answers to 1, 2, 3, 4, 
6, 7, and 8. Read it again as often as you need to. 


John went to the store to work and Will went to 


school, but Fred went to the park and played ball. 
Will and Fred came back at four o’clock. John did 
not come back until after six o'clock. 
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D 


Read this and then write the answers to 1, 2, 3, 4, 
5, 6, 7, and 8. Read it again as often as you need to. 


John had two brothers who were both tall. Their 
names were Will and Fred. John’s sister, who was 
short, was named Mary. John liked Fred better than 
either of the others. All of these children except Will 
had red hair. He had brown hair. 
RS 


2. Was John’s sister tall or short ?.................. 


Seeconvee ee eeeeaeeeooeoeoezee sees esesesegaeeeeenseoose oes 
erevreeeeee eee ereeee eee eeeneee 

eeerereeeereeee eee eee e ee eee eee ® 

eoeereer eer eee eee ee ee eee eeeeer eee ee 


Poeeseseooeooeoc oe een oe oe 84 
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E 


Read this, and then write the answers to 1, 2, 3, 4, 
5, 6, 7, 8, 9, and 10. Read it again as often as you 
need to. 

Long after the sun had set, Tom was still waiting 
for Jim and Dick to come. “If they do not come 
before nine o’clock,”’ he said to himself, ‘‘ I will go on 
to Boston alone.” At half past eight they came, 
bringing two other boys with them. Tom was very 
glad to see them and gave each of them one of the 
apples he had kept. They ate these and he ate one 
too. Then all went on down the road. 


1. How many boys are told about ?................ 


2 
3B. Wren did they COGNO ? ... .. ocd waice Se 00 vc cic Hedin 
4 


“eee eee eeeeneneeee eee eee eeee ee eeeeeeeeee eee ee ee 


“eer eee eeeweeereeeeeeneeeeeeeeee eee e eee en ee ee ee eee 
“eee eeeeeeeeneeeeeeeeeeweee eee eeeeeeeeeeeeeeeeee 


*eeeree ee eeeeeeeaeee eee eeeeeeeeewee eee eee eee eenee 
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9. How long did Tom say he would wait for them ?.. 


eoeerrvreeveeer eee eee eevee eeeeeeeeeeeeeeeeeeeeeeenes 


Read this and then write the answers to 1, 2, 3, 4, 
5, 6, 7, 8, 9, and 10. Read it again as often as you 
need to. 


It may seem at first thought that every boy and 
girl who goes to school ought to do all the work that 
the teacher wishes done. But sometimes other duties 
prevent even the best boy or girl from doing so. If 
a boy’s or girl’s father died and he had to work after- 
noons and evenings to earn money to help his mother, 
such might be the case. A good girl might let her 
lessons go undone in order to help her mother by 
taking care of the baby. 


1. Must a good boy always do all his school work ?.. 


oeerevrereeveseeeeeeeeeeveesee eevee eeeeeeeeeeeeeeeeeee 


eeetoeeneoeaeaeedgcewetzoesaoeeseee@ eee CaeBeeaoseoeonaneenene cues ee 
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10. 
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4, Answer the question just asked, supposing it to be 


6o@ee*etoeoeooaosveoeeocoeo eee Ceves eqn Cees aeee aban ese ereeeenes 2.5 oe 


emweeeeoeonvcasc oo Cee eend ee OSes eee Pe 2899455 6 22 Gees ses So 


. What might be the effect of his father’s death 


upon the way a boy spent his time? ............ 
Who is mentioned in the paragraph as the person 


who desires to have all lessons completely done ?. . 


S@esescdco eos oa eC eae eee eo ges eosee ee eee 62 9'6 4 2 oe 2 2 ae 8 6 eo 
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Do what it says to do 


. Write the letter a. 


. If two and two are five, write the letter 6. But 


if two and two are four, write the letter c. 


. If two and two are more than two and four, write 


the letter d, but if they are less than two and 
four, write the letter e. 


. If the word that you see here after cat is dog, 


cross it out. cat dog. 


. Cross out all words on the next line which have 


both e and ¢ in them. 
meat dress tack Peter guess tree. 


. If any word on the two short lines below has an 


a and also a 6 in it, do not cross it out. If it 
has an a in it and not any 3 in it, cross it out. 


bull tremble breakfast ask 


beat tear board animal 


. Look at these words. idle tribe inch it ice 


iy tide true tip top tit tat toe. 
Cross out every one of them that has an 7 and 
has not any ¢ (7) in it. 


. If the first word that you saw in this line had an 


a in it, cross out every a in that line. 


. Look at these words. light white bright spite 
piteous city cited 














10. 


~ 


CS NDA PS Ww 
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Whenever in those words you see the letter ¢ with 
an 7 on one side of it and an e on the other, draw 
a line under all three. 

Look at the two short lines below. Unless you 
see a word which has the letters ¢, h and e all in 
it, do not do anything. But draw a line under 
any such word and draw a line over the word that 
comes next after it. 

when then up down these and _ those 


if but were mot never there yet 


VI 


Do what it says to do 


. Write the letter ” three times. 


Draw a line under the word that begins with w. 
big dog sick well had 


Make the shorter line longer. ——_ —_—— 
How many are two and one ? 

How many ears has a cat ? 

Put a dot over thei in pig. Pig. 
Put two dots in the square. a 
Put one dot in the middle circle. O OO 





. Draw a line below the square. [- O 























= = ee = ee eee 
a 2 RS ES PS ES 


10. 
11. 
12. 
13. 
14. 
15. 
16. 


17. 


18. 


19. 


20. 
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Draw a line around the circle. [] O 

Write your name. 

Copy the second of these words. big bag beg 
Copy each of these words. rose nose goes 
Cross out the smallest dot. e . » 

Cross out the largestd. dd,d 


Cross out each @ in these words. Advantage 
derivation. 


Which is the coldest—spring, summer, autumn or 


SB O42 O48 SSS 6 OS OC MSREA Ces eoece eae sen eeeense eee G4 ORF 
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x 


. Draw a line under every 4 in these two lines of 
numbers: 


94749 4 
4 2 


m © 


3 4 3.4 9 
6 3 1 4 8 
. If the first figure is 4, draw a line under every 4 
in this line; but if the first figure is 6, draw a line 
over every 9: 


62491793484595642917 


. In these four lines, draw a line under every 5 in 
the first line and under every 6 in the second line. 
Draw a line under only the first and last figures in 
the third line. Do nothing at all to the fourth line: 


729 6 1 4 Sao ts 
3.5 6 8 7 69263 7 
§ 29 6 ¢ 6 237396 
9 47 3 $57 4-9 2 6:2 ee 


ore oO 


3 
+) 
1 


_~ — O1 
woo. 


8 2 


. In these lines, when you see a figure 4 between a 
2 and a 9, draw a line under it. But when you 
see a 4 between a 6 and a 3, draw a line over it: 


S t @ 8 2 4° 2 Ve 2S eee 
89 6§ 6 4 7: 8 48 @ 4. 3a 
. In these two lines draw a line under every 5 that 
comes just after a 2, unless the 2 comes just after 


a9. If that is the case, draw a line under the next 
figure after the 5: 


936254174257654925386125 
473523925847925612574856 








j 
it 


Ce ee ee 
a 


——— 


eae nae aa aa 


SSS SSeS SS 


gaia ae ne ei 


oer 


SSiesaia 


Soe ee 
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F. In these three short lines, when you see an 8 with- 
out a 3 just after it, draw a line under the figure 
that comes just before the 8: 


8428371859 8 
6 8 283 5 4 8 
3 2 168 7 4 8 


Ww oO vo 


5 3 1 

a 8 9 

G. In the first of these four lines, draw a line under 
every 6 except the first and the last in the line. 


In the second of these four lines, draw a line under 
as many of the 6’s as you did in the first line. 


In the third line, mark only the first and the next 
to the last 6. 


In the fourth line, mark only where there are two 
6’s that come side by side: 


62196746382167639016 
56769136276186376426 
6387967169466 


61566729618463667166943682 


In the A, B, C, D, E, F type of measure, the ability to under- 
stand a paragraph and certain questions asked is measured by 
the correctness of verbal responses, in much the same way as 
is done in the daily reading of a school. Special care is taken, 
however, to make the task of expression very easy. In C, for 
example, the pupil has merely to write ‘‘ To school,” “ Played 
ball,”’ “‘ In a store,” ‘“ Will and Fred,” “ John,” “‘ Four,” “At 
the park,” and “ No,” or even simpler phrases that give the 
facts. The task of expression is harder with F, but relatively 
to the reading task, it is easy. Special care is also taken to 
make the scoring easy. Work that engages a pupil for thirty 
minutes can be fully scored in three minutes or less. Special 
care is also taken to measure understanding as conditioned by 
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the constructional difficulties of a paragraph rather than by 
the difficulties of single words. Even in F, for example, only 
common words are used. 

In the V, VI, X type of measure the ability to understand a 
sentence or short paragraph is measured by the correctness of 
a response that may not be verbal at all. In X, the pupil is 
made familiar with the work of checking numbers in an easy 
case and then is given sets of instructions where the response 
is easy enough to make, provided he has understood the instruc- 
tions, and keeps them in mind. 

With the knowledge that has come from experimentation with 
these tests, I could now improve them. Questions with two 
possible answers only (like B 3, 4, 8; D 1, 2, 4; F 1, 2) I should 
now omit. The original plan was that the reading of the para- 
graph and all the questions about it would be used as a unit, 
in which case the half-chance by chance for a single element 
did no harm. But it now appears that we can measure in 
smaller units. I should make it clearer that the questions 
were to be answered from the paragraph. For example, F 7 
might better be ‘“‘ What is said in the paragraph to seem at 
first thought to be true, but really to be false.’”” The marking 
tests should be preceded by some with even simpler instruc- 
tions; V 5 should be made less ambiguous; V 1, V 2 and V 3 
should probably have “in the circle’ added in each case with 
a circle printed at the right. 

The general plan, however, of passage-question measures and 
response by marking letters, numbers and the like seems entirely 
satisfactory, and it seems certain that the construction of many 
graded series similar to the A-F, or X, or V series and the selec- 
tion from among them of an exactly graded series on the basis 
of results from several thousand pupils will produce a very 
useful scale. 

Indeed, even the provisional and incomplete scale achieved 
with very limited time and facilities is useful. With all its 
faults, it is a convenient means for measuring the achievement 
of a class or a school-system in silent reading. This beginning 
of a scale is as follows: 
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ScaLE ALPHA. For MEASURING THE UNDERSTANDING 
OF SENTENCES 


SET a OR 4 


Read this and then write the answers. Read it 
again as often as you need to. 


John had two brothers who were both tall. Their 
names were Will and Fred. John’s sister, who was 
short, was named Mary. John liked Fred better than 
either of the others. All of these children except 
Will had red hair. He had brown hair. 


SET 6 OR 6 


Read this, and then write the answers. Read it 
again as often as you need to. 


Long after the sun had set, Tom was still waiting 
for Jim and Dick to come. “If they do not come 
before nine o’clock,” he said to himself, “‘I will go 
on to Boston alone.”’ At half past eight they came 
bringing two other boys with them. Tom was very 
glad to see them and gave each of them one of the 
apples he had kept. They ate these and he ate one 
too. Then all went on down the road. 




















251] The Measurement of Ability in Reading 45 


eeeoesesc oe eee ee eac ewes v ae eecesvanscaeseeveseesescnvereesee eee & 


ee 


SET c OR 8 


Read this and then write the answers. Read it 
again as often as you need to. 


It may seem at first thought that every boy and 
girl who goes to school ought to do all the work that 
the teacher wishes done. But sometimes other duties 
prevent even the best boy or girl from doing so. If 
a boy’s or girl’s father died and he had to work after- 
noons and evenings to earn money to help his mother, 
such might be the case. A good girl might let her 
lessons go undone in order to help her mother by 
taking care of the baby. 


1. What are some conditions that might make even 


oeereereeeeeeneeneeneeeeee eee eee e eee eee eeeeeeeeeeeneee 
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Seeccaeosna es oeoeesee@awaesecsooeaeeeeeoeasvoeeono oe Geese eosnuoaoes ese ee 


4. Look at these words: idle, tribe, inch, it, ice, ivy 
tide, true, tip, top, tit, tat, toe. 
Cross out every one of them that has an 7 and has 
not any ¢ (T) in it. 


SET d OR 10 


Read this and then write the answers. Read it 
again as often as you need to. 


It may seem at first thought that every boy and 
girl who goes to school ought to do all the work that 
the teacher wishes done. But sometimes other duties 
prevent even the best boy or girl from doing so. Ifa 
boy’s or girl’s father died and he had to work after- 
noons and evenings to earn money to help his mother, 
such might be the case. A good girl might let her 
lessons go undone in order to help her mother by 
taking care of the baby. 


1. What is it that might seem at first thought to be 


eee eereeeeeee eevee eeeeee ee eee eer eer eee er eee eevee nee 


eeepeseees @esceveeeaseseooaoene@edsdoaoseuonveon sc eeuevevueeseeae sen oee ee 
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3. Who is mentioned in the paragraph as the person 


who desires to have all lessons completely done ? 


4. In these two lines draw a line under every 5 that 
comes just after a 2, unless the 2 comes just after 
a9. If that is the case, draw a line under the next 
figure after the 5: 


936254174257654925386125 
473523925847925612574856 


This scale is available for grades 3 to 8. The tests above 
are given after the preliminary test shown below. During 
the preliminary test the teacher explains the general nature of 
the test to any individual who fails to succeed with the pre- 
liminary tests. Time will be saved by announcing that the 
answers to the questions need not be in complete sentences 
and that spelling ‘does not count ’’—that the pupils need 
write only what will show that they understand the sentences. 

The time allowed should be enough for each pupil to do all 
that he is able to do. I suggest 30 minutes, though 20 is prob- 
ably ample. As with the Vocabulary Scale, the test sheets 
may be handed in when completed, the time being secretly 
recorded, or all may be collected at the time-limit. Each plan 
has its advantages. 


PRELIMINARY TEST FOR USE BEFORE SCALE ALPHA 


Read this and then write the answers to the ques- 
tions. 


Tom gave a gray cat to Mary. She gave him a 
black dog. 


eereeeree eee wee eee eee we eee eee 
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Read this and then write the answers to the ques- 
tions. 


Your nose is on your face. Your fingers are on your 
hands. Your teeth are in your mouth. 


Dick took a bat. Fred took a ball. Will took six 
cents. 


In an ideal scale for measuring achievement in reading the 
responses will be clearly either right or wrong even to an un- 
skilled scorer. It is, however, difficult to attain this desideratum 
in the case of very hard reading without sacrificing other desired 
qualities. 

In the case of tests A, B, C, and D, this end is substantially 
attained. A person who could not even read the paragraphs _ 
might be taught to score them. All that is necessary is to note 
that in C4, “Will” or “Fred” should be called wrong, and 
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that in D6 either “‘all except Will’’ or ‘John, Mary and Fred” 
should be called right. 

In the case of Test E, there is required some judgment on 
the part of the scorer. The general intent should be to require 
an answer that proves that the pupil has understood the passage 
perfectly. In calculating values for the scale, for example, 
“down the road’’ instead of “Boston” as an answer to E4 is 
scored as wrong, ‘“‘before nine o’clock’”’ is called wrong as an 
answer to E9, “they went to Boston” and “they went away”’ 
are called wrong as answers to E10. 

In the case of some of the questions of Test F still more 
judgment is necessary. The plan which was followed in deriv- 
ing the scale was to have each response scaled from zero to 
four (or five in some cases) according to the following plan. 
The standard of correctness was taken as 4 or 5, though it 
would be possible to use a less rigorous standard. 


PLAN FOR SCORING TEST F yo, . 43 6 


F.1. Yes 0 
Yes doall 0 
Yes if he wants to be promoted 0 
Yes but sometimes 0 
Yes he always does 0 
He must do all his work 0 
He must do all the lessons that the teacher wishes 0 
All that the teacher asks him 0 
Yes but other duties prevent them 2 
Yes if he has not anything to keep them home 2 
Yes if both parents are living 3 
If itis possible 3 
No 4 
No if the boy’s father died 4 
No sometimes his father died and he had to earn money etc. 4 


F.2. No 0 

No she never will 0 

Yes if she is careless 0 

A good girl will not fail 0 
If it is impossible 3 

Yes 4 

Yes when it isimportant 4 





oe = 
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Yes if she has to help her mother 4 

Yes sometimes she minds the baby 4 

Yes to help her mother 4 

Sometimes 4 

Sometimes a good girl fails to get all her lessons 4 


. Playing ball, etc. 0 

Going with bad boys 0 

Towork 1 

Toearn the money 1 

Have to work out to get money 2 

Because to help their mother 2 

If he has to work for aliving 4 

If he has to work afternoons and evenings fo help his mother 4 
When the father dies 4 

When their parents died 4 

If his father died and to work 4 

If his father died or if sick 4 

His father might die 4 

His father may died 4 

If his father died he has to work 4 

If his father or mother died 4 

If a boy’s father dies he has to earn money for his mother 4 
When some one dies in their family 4 

Help support the family 4 

The condition is in case his father died 5 

If his father died he might have to go to work 5 
If his father died he might have to work 5 


. Itsaboy 0 

It supposed to bea boy 0 

By going with a bad girl 0 

Playing with a dolletce 0 

She would have to go boarding and have to work 0 
Tend the baby 2 

Take care of baby 2 

To mind a baby 2 

She would take care of her baby 2 

The girl sometimes minds the baby 2 

To help her mother by taking care of the baby 2 
To help her mother and take out the baby 2 
Leave her lessons undone and help her mother 2 
To wash dishes if the mother is sick 2 

To earn money by sewing 2 

If she had to help her mother 4 








F. 6. 





F. 5. 
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She might have to mind the baby 4 

A good girl may leave her lessons to take care of the baby 4 

A good girl might let her lessons go undone to mind the baby 4 
Mother may of died 4 

If her mother died 4 

Her mother might die and she would have to take care of the house 4 
When the mother is sick 4 

Her father might die 4 

The same as for question3 4 

If her father died 4 

If his father died or is sick 4 


Be good 1 

To do hislessons 1 

Help with things in the house 2 
Prepare the table 2 

To do the work his father wish him todo 2 
Go to the store 2 

Help his mother 2 

Help his father 2 

Work 4 

Towork 4 

Work afternoons and evenings 4 
Work in the evening 4 

Work to earn money for mother 4 
Work and earn some money 4 

He might have to work 4 

A boy might work 4 

Go out and work 4 

By working 4 


Lazy 0 

Ficks the beds 2 

By being good 2 

Help her mother 2 
Work 2 

To take out the baby 3 
By washing dishes, cleaning 3 
Wash dishes 3 

Help her mother wash the dishes 3 
By helping her to wash the dishes 3 
Wash and clean the house etc 3 
Help clean the house 3 

To take care of the house 3 

Take care of the baby 4 
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F. 7. 


F. 8. 
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To take care of the baby 4 

Mind the baby 4 

By minding the baby 4 

She could take care of the baby 4 
Care for the baby 4 

By taking care of the baby 4 

To do house work or mind the baby 4 


Totrue 0 

Go to the home of the boy and see if it is true 0 
To leave school and work 0 

To stay home from school and not work 0 

Lessons undone and loafing and truancy 0 

When you are dressed different 1 

When a boy or girl thinks he must work very hard 
That his father died and did not 2 

That his money was stolen but he really spent it 2 
The boy said he lost his money but spent it 2 

To say he did his lesson but did’nt 2 

Alie 2 

That they should do their work 3 

To do all the work that is asked 3 

It seems that all children must do all work 4 

That everybody must do their lessons 4 

That a good boy or girl always does their lessons 5 
A good boy or girl to do all their school work 5 
Every boy or girl might do all the teacher wishes 5 


Good and false 0 

Bad 0 

What they have todo 0 
What has no father or mother 2 
Without parents 2 

Good boys and girls 4 

A good boy and a good girl 4 
All good boys and good girls 4 
School boys and girls 4 

Poor 4 

It seems to be a poor family 4 


. By the boy not working if his father lost his job 


By not doing what his father told him 0 
Sickness 0 
Makes the father work 0 


1 
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Loafing and doing nothing 1 

Loafing and not working 1 

Go with bad companions 2 

Bad and not doing his lessons 2 

Idling 2 

Go away and not come back till night 2 

To take the job that his father had 2 

It might be good effect 3 

Work 3 

A boy would work 3 

He had to work afternoons and evening 3 

To work afternoons and evening 3 

Working or making his living 3 

To spend working 3 

He would have to work all the time 4 

He would work instead of going to school 5 

He might have to work to support the family 5 
He would have to go out to work 5 

He would have to work 5 

He would have to work afternoons and evenings 5 


F.10. Aboy 1 
A boy and girl 1 
A boy or girl 1 
The boy 1 
The child with both parents 1 
A good person 1 
Good boys and girls 2 
A good boy and a good girl 2 
The best boys and girls 2 
The best boy and girl 2 
Who cares about his lessons 2 
The teacher 5 


In the case of tests V and X, scoring may follow the rules 
given below, the intent being to score as correct any response 
which indicates with fair surety that the pupil read and under- 
stood the directions. Cancellation of everything required by 
the directions with no wrong cancellations is not to be demanded, 
for even a highly educated adult will not attain such perfection 
in the test. The test is of ability to read, not of precision in 
perceiving certain letters or numbers. 














Test V. 
“ 


kee 


Test X. 


a: 2 2. 
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a is right, anything else is wrong. 


. cis right, anything else is wrong. 

. eis right, anything else is wrong. 

. Either “‘dog’’ crossed out is right, anything else is wrong. 

. Two or more e-t words checked and no others checked = right; 


or all four e-t words checked with one wrongly checked 
word = right. 


. Any two of the right words checked and no wrong words 


checked = right; or all three right words checked and one 
wrong word checked = right. 


. Three or more rightly checked with no word wrongly checked 


= right; or all four words rightly checked with not over 
two words wrongly checked = right. 


. Nothing done is right. 
. At least three words rightly checked with not over one word 


wrongly checked (the lines being drawn under all three or 
approximately so) = right. 


. The omission of two marks or the improper placing of two out 


of the eight is to be allowed without depriving the individ- 
ual in question of a score as right. 


. If at least eight of the 4’s are underlined and not over two 


figures wrongly marked, call right. 


. If at least three of the 9’s are overlined and not over one 


figure is wrongly marked, call right. 


. Line 1. At least two 5’s and no wrongly marked figure. 
. Line 2. At least three 5’s and no wrongly marked figure. 
. Line 3. First and last figure underlined and no others. 


Line 4. Nothing at all done. 


. If at least two of the 249’s are properly marked and no other 


figure is marked, call the response right. 


. If at least three of the “‘25’’ sequences and at least two of the 


“‘925”" sequences are properly marked and if there are no 
wrongly marked figures, call the response right. 


. If there are not over two omissions or wrongly marked figures, 


call the response right. 


. Line 1. At least three rightly marked and no wrongly marked. 


Line 2. Exactly as directed. 


. Line 3. Exactly as directed. 
. Line 4. At least two of the 66’s and no wrongly marked figures. 


The most economical method of measuring a class is to 
arrange the papers alphabetically. Score first the set which one 
thinks will come nearest to 80 per cent of correct responses for 
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TABLE XI 
RECORD SHEET FOR MEASUREMENT BY SCALE ALPHA 


Number of wrong responses 








Name Set a or 4!Set 6 or 6|Set c or 8} Set d or 
10 


















































the class, enter the results on a scoring sheet like that shown 
in Table XI, compute the result for the class, and then score 
the set above or below it in difficulty if necessary. The diffi- 
culty required to get just 20 per cent of wrong responses may 
be estimated from the actual percentages obtained with the 
sets of the scale by using Tables VII, VIII and IX, but multi- 
plying the table-entry by 2 in every case, since the difference 
between the consecutive “ sets”’ 4, 6, 8, 10 of Scale Alpha is 
twice the difference between two consecutive “ lines”’ in Scale 
A. On account of the small number of “‘sets,”’ or steps of the 
scale, the estimate may be made from the percentage nearest 
to 20, if there is one between 12 and 30. If there is no such, 
the two whose sum comes nearest to 40 may be used. 

I illustrate below the treatment of the scores in the case of 
fifteen boys, all twelve years old, and all from the same school, 
five being in grade 4 A, five in grade 6 A, and five in grade 7 B. 
The detailed scores were as in Table XII. 
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TABLE XII 
DETAILED SCORES OF FIFTEEN 12-YEAR-OLD PupiLs By SCALE ALPHA 


Score recorded in Scale X for each element 


a b c d 
Pupil Grade 1 2 3 n= fs '3 3 4 i-2 2m 
A 4A x x x x 2 2a z 2 £2 
B - ‘2.2 2% zs zs es 
* . x z © 2 2 2 zs Ss 
D ” x x sz & 2 ss: 4:9 
E ? 2 = ae oe 
F 6A 2p & a 
G 5 x zs 
H - x x x 
I S x 2 zs 3 x 
J " x x x 0 x x 
K 7B x x 
L ° xf 
M * x x Os & 2 
N ° x 
O - x x 


The percentages of wrong responses for each group for each 
set were: 
Set a Setb Setc Setd 


4Agroup 6.7 28.0 95 100 
6Agroup 0 0 50 65 
7Bgroup 0 4.0 10 50 


The degree of difficulty required to produce 20 per cent of 
wrong responses would then be (calling the difficulty of Set a, 
4; that of Set b, 6; that of Set c, 8; and that of Set d, 10) as 
follows: 


4 A group—about 4.7 
6 A group—about 6.5 
7 B group—about 9 


It is clear from the above, first, that the scale is adequate 
to show differences in reading ability, but, second, that inter- 
mediate sets are much needed. 
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LIMITATIONS TO SCALE ALPHA 


So far, except for a warning at the beginning of the section, 
Scale Alpha has been described as if the degrees of difficulty (4, 
6, 8 and 10) were exact, and as if the different elements of each 
set were equally difficult to respond to correctly. As a matter 
of fact, however, it will require an enormous amount of labor 
to determine at all exactly the relative degrees of difficulty of 
these different elements; and the 4, 6, 8 and 10 are not much 
better than convenient guesses. Indeed, I know that the 
values for these sets will mot be at all exactly 4, 6, 8 and 10, 
that the difficulty of the fourth set will not be exactly two 
and a half times that of the first. By using fractional numbers 
I could approach nearer the truth. But I have left the esti- 
mates as convenient whole numbers in order to facilitate the 
understanding and use of the scale. 

I have records from only about 1100 pupils, some of whom 
were not tried with all the elements finally retained in the 
scale. There will be required tests of over four thousand pupils, 
each with fifty or sixty response elements, in order to locate 
four or more “‘sets,”’ the elements of each being equal in diffi- 
culty within five per cent and the increases in difficulty from 
one set to the next being equal within five per cent. 

Future work will improve the scale greatly in these respects, 
but even as it stands, the resulting comparison of two classes 
will be much fairer and more exact than probably even the 
most capable supervisor of reading would arrive at by ten hours 
of oral questioning. And the results will be readily comparable 
with thousands of others obtained with other classes by other 
supervisors, and will be at once understood by anybody who 
knows the scale—a most desirable feature, which no ordinary 
school examination possesses. Consequently, though I have 
presented Scale Alpha chiefly as an illustration of the sort of scale 
to be constructed, its use even now will do much more good 
than harm. It will do no harm if we remember that it is pro- 
visional, that 4, 6, 8 and 10 may well turn out to be 4.8, 6.3, 
7.7 and 9.5, or 5, 6, 8 and 9, or 6, 7, 8.5 and 10, or other values 
differing rather widely from the 1, 14, 2, 2} ratios. 

I may say that the equality in difficulty of the different 
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elements of the same ‘“‘ set’ is somewhere nearly sufficient for 
practical purposes, the facts being as shown in Table XIII. 


TABLE XIII 


Data CONCERNING THE DIFFICULTY OF EACH ELEMENT OF EACH SET oF 
ScALE ALPHA: THE PERCENTAGE OF CORRECT RESPONSES 
FOR CERTAIN Groups TESTED 





8th grade pupils in school B (n = 110) 
6th grade pupils in school B (n = 130) 
7th grade pupils in school A (n = 136) 
6th grade pupils in school A (n = 132) 
5th grade pupils in school B (n= 95) 
5B grade pupils in school A (n = 105) 
5A grade pupils in school A (n = 105) 
3rd grade pupils in school A (n = 105) 


88 7th grade pupils in school B (n = 102) 
S&S 4th grade pupils in school A (n = 105) 


Set a 1 97 98.5 97 97.7 97.9 97.1 99 94.3 
98 97.7 96 96.2 94.7 97.1 100 93.8 
3 100.5 99 100 98.9 98.5 100 100 100 98 97.9 
Set b 1 100 99 99.3 97.1 91.7 94.7 96.2 %6 80 72.9 
2 95 98 94.6 97.7 81.1 90.4 94.3 95 81.9 72.9 
3 95 91 93.8 91.4 92.4 89.5 87.7 89.5 72.4 76 
4 98 96 93.8 93.1 91.7 86.4 86.7 90.5 76.2 76 
5 93 95 95.4 89.1 90.2 89.5 84.8 91.5 73.3 61.5 
Set c 1 85.5 71.6 79.2 71.3 75.0 62.1 71.4 63.8 
, 82.4 55.4 80.1 56.8 75.8 81.9 66.7 
3 87 79.5 77.4 69.1 64.4 65.3 72.4 56.2 
4 See below 
Set d 1 62 72.5 42.3 47.8 30.3 24.1 41.9 28.6 
2 62 60.8 46.2 42.6 34.8 43.2 26.7 32.4 
3 64.5 72.5 37.7 48.5 31.1 36.8 23.8 33.3 
4 See below. 


PE nto c be aoe Set d 4 were tested with School A, grades 4-7 only. The aver- 

e correct for grades 6 and 7 of School A with Set c, 1, 2 and 

3 3 was 69.5; or grades 5A and 5B it was 68.7. Set c 4 gives 66.0 and 69.8 

as corresponding percentages and may be regarded as roughly equal to c 1, 

2, 3 in difficulty. Ina similar way d 4 is found to be roughly equal to d 1, 
2, 3 in difficulty. 
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The equality of the intervals of difficulty between successive 
“‘sets’’ and the placing of Set a as two-fifths as far from 
zero difficulty as Set d, are much more insecure—are, in fact, 
only the roughest sort of estimates. The scientific reader may 
think of the difficulty of Set a, Set b, etc., as follows: 


Call the difficulty of Set a, A 
Call the difficulty of Set b, B 
Call the difficulty of Set c, C 
Call the difficulty of Set d, D 


Then D-C is probably between .4 (C-B) and 1.2 (C-B) 
D-C is probably between .7 (B-A) and 1.3 (B-A) 
C-B is probably between .7 (B-A) and 2.2 (B-A) 
D-A is probably between .5A and 2A. 
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THE EXTENSION AND IMPROVEMENT OF SCALE ALPHA 


Since many of those who read this report will wish to try 
not only Scale Alpha, but also other similar tests, in the case cf 
the pupils of whom they have charge, I present here scme of 
the tests which will probably help to extend the scale to greater 
difficulties, fill in intermediate sets, and add other elements 
equal in difficulty to those now given in a, b, c, and d. 


H 


Read this and then write the answers to 1, 2, 3, 4, 
5, and 6. Read it again as often as you need to. 


You need a coal range in winter for kitchen warmth 
and for continuous hot-water supply. but in summer 
when you want a cool kitchen and less hot water, a 
gas range is better. The xyz ovens are safe. In the 
end-ovens there is an extra set of burners for broiling. 


1. What two varieties of stoves does the paragraph 
mention ? 


2. What effect has the use of a gas range instead of 
a coal range upon the temperature of the kitchen ? 


3. What is needed to provide a supply of hot water all 
day long ? 


4. For what purpose is the extra set of burners ? 
5. In what part of the stove are they situated ? 


6. During what season of the year is a gas range 
preferable ? 


I 


Read this and then write the answers to 1, 2, 3, 4, 
and 5. Read it again as often as you need to. 
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Nearly fifteen thousand of the city’s workers joined 
in the parade on September seventh, and passed before 
two hundred thousand cheering spectators. There were 
workers of both sexes in the parade, though the men 
far out-numbered the women. 


1. What is said about the number of persons who 
marched in the parade ? 


bo 


. Which sex was in the majority ? 


3. What did the people who looked at the parade do 
when it passed by ? 


a 


. How many people saw the parade ? 


on 


. On what date did the event described in the para- 
graph occur ? 


J 


Read this and then write the answers to l, 2, 3, 4, 
5,6, and 7. Read it again as often as you need to. 


In Franklin, attendance upon school is required of 
every child between the ages of seven and fourteen 
on every day when school is in session unless the child 
is so ill as to be unable to go to school, or some person 
in his house is ill with a contagious disease, or the 
roads are impassable. 


1. What is the general topic of the paragraph ? 


2. On what day would a ten-year-old girl not be ex- 
pected to attend school ? 


3. Between what years is attendance upon school com- 
pulsory in Franklin ? 
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4. How many causes are stated which make absence 
excusable? 


5. What kind of illness may permit a boy to stay away 
from school, even though he is not sick himself ? 


6. What condition in a pupil would justify his non- 
attendance ? 


7. At what age may a boy leave school to go to work 
in Franklin ? 


K 


Read this and then write the answers to 1, 2, 3, 4, 
5, 6, 7, and 8. Read it again as often as you need to. 


Hay-fever is a very painful, though not a dangerous, 
disease. It is like a very severe cold in the head, 
except that it lasts much longer. The nose runs; the 
eyes are sore; the person sneezes; he feels unable to 
think or work. Sometimes he has great difficulty in 
breathing. Hay-fever is not caused by hay, but by 
the pollen from certain weeds and flowers. Only a 
small number of people get this disease, perhaps one 
person in fifty. Most of those who do get it, can 
avoid it by going to live in certain places during the 
summer and fall. Almost every one can find some 
place where he does not suffer from hay fever. 


1. What form of illness is described in this paragraph ? 


2. What is the effect of hay-fever on the eyes and 
nose ? 


3. What is the cause of hay-fever? 


4. How large a percentage of people get hay-fever ? 
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5. What means could they take to keep from getting it ? 


6. During what seasons of the year would a person 
have the disease described in this paragraph ? 


7. What is one difference between a cold in the head 
and hay-fever that is stated in the paragraph ? 


8. What effect is attributed to some weeds by the 
paragraph ? 


L 


Read this and then write the answers to 1, 2, 3, 4, 
5, 6, 7, and 8. Read it again as often as you need to. 


We often think of a rich man as one who has much 
money, as if money and wealth meant the same thing. 
However, money is only one sort of wealth and some 
money is not exactly wealth. A twenty dollar bill, for 
example, is only someone’s promise to pay so much 
gold. Wealth means land, houses, food, clothes, jewels, 
tools, gold, silver, coal, iron,—anything that a man can 
have that satisfies some want. Money means something 
which a person can exchange for any one of many 
sorts of wealth. The main value of any piece of 
wealth, such as a barrel of flour, a house, or a cow 
is the direct use you can make of it. The value it 
has by reason of what you can exchange it for is of 
less importance. The main value of any piece 
of money, such as a silver dollar, a ten-dollar bill, or 
a nickel, is mot any direct use you can make of it. Its 
_ value is by reason of what you can exchange 
it for. 


1. What is the general subject of this paragraph ? 


2. How could a man be rich and still not own a single 
penny of money ? 
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. What two things are contrasted in this paragraph ? 


. In what does the main value of wealth lie ? 


3 

4 

5. In what does the main value of money lie ? 

6. Name something that is wealth, but is not money ? 

7. Name something that is money, but is not exactly 
wealth ? 


8. What do you suppose is the thing which is defined 
by business men as “‘a medium of exchange ?”’ 


M 


Read this and then write the answers to l, 2, 3, 4, 
and 5. Read it again as often as you need to. 


However certain it may seem to be that men work 
only because they must, and would avoid labor except 
for the food, clothing and luxuries that are its rewards, 
the facts may well be to the contrary. It can hardly 
be the case that men dislike work because they wish 
to be utterly idle. For mere rest, mere inactivity, is 
not commonly enjoyed. To have nothing to do is 
not what men seek. Were that so, we should envy 
the prisoner shut up in his cell. If men had to choose 
between a life spent at eight hours of work daily in a 
factory and a life spent at eight hours of sitting on 
a throne without moving hand or foot, many of them 
would, after trying both, choose the former. Activity 
of body or mind, at which a man can succeed, is, in 
and of itself, rather enjoyed than disliked. 


1. What is it that this paragraph says may seem sure, 
but probably is false ? 
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2. 


In what respect is a prisoner in his cell like a man 
with a million dollars ? 


. If the absence of any activity were what we wished 


for, what would be our attitude toward a prisoner 
in his cell ? 


. What is stated in the paragraph to be really liked 


and not objected to? 


. What choice is described in the paragraph as an 


argument that work, merely as such, is not 
always avoided ? 


N 


. Draw a line under every 7 in this line of numbers: 


94749127637298721 


. In these two lines of numbers draw a line under 


every 5 that comes just before an 8: 
25863795821513645810 
73516293587132581352 


. In these three lines draw a line under every 2 that 


stands just between a 1 and a 3: 
952761234715243 
14263536612358 
1239875156273 4 


. In this line draw a line under every two numbers 


which stand side by side and whose sum is ex- 
actly 10: 


328569643146549156 
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5. In these two lines draw a line under every 6 that 
comes just after a number smaller than it and 
just before a number larger than it: 


76438469886912367 
36617268522657169 





7. Wherever in this line you see a 9 immediately pre- 
ceded by a 1 and immediately followed by a 2, 
draw a circle around all three: 


62851923715392619481923592192 


8. In these three lines draw a line under every 7 that 
comes just after a 4, if also there is a 7 just 
after the 6. But if the figure just after the 6 
is not a 7, put the line over the 6 instead of 
under it: 


246197467861467 
5613463289467163468 
6462546719346526 


9. In these two lines draw a line under every 5 that 
is both preceded and followed immediately by a 
number larger than it, unless that number is 9. 
If a 9 occurs just before or after the 5, draw a 
circle around all three numbers: 


17586258219579728535317 
75947165631085978562458 
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A PROVISIONAL SCALE FOR MEASURING ABILITY TO 
PRONOUNCE ENGLISH SENTENCES 


During the year 1913-14, Mr. W. S. Gray made, with some 
help from the author, a preliminary study of tests of efficiency 
in oral reading. This work he expects to continue, and the 
result will be a series of sets of passages, each set being of 
equal difficulty and the sets in order being graded from little 
to great difficulty by exactly defined steps of difference. 

The scale to be presented here represents his first rough 
approximation to such a series and is made public now because, 
with all its inadequacies, it is very much better than any other 
one means at hand for measuring ability in pronouncing Eng- 
lish sentences. 

The passages are the following :— 





THe Gray TENTATIVE SCALE FOR MEASURING ACHIEVEMENT 
IN ORAL READING 


Passage a 


It was time for winter to come. The little birds had all 
gone far away. They were afraid of the cold. There was no 
green grass in the fields, and there were no pretty flowers in 
the gardens. Many of the trees had dropped all their leaves. 
Cold winter with its snow and ice was coming soon. 


Passage b 


Once there lived a king and queen in a large palace. But 
the king and queen were not happy. There were no little 
children in the house or garden. One day they found a poor 
| little boy and girl at their door. They took them into the palace 

and made them their own. The king and queen were then 
happy. 
Passage c 





Once I went home from the city for a summer’s rest. I took 
my gun for a stroll in the woods where I had shot many squir- 
rels. I put my gun against a tree and lay down upon the leaves. 
Soon I was fast asleep, dreaming of a group of merry, laughing 
children running and playing about me on all sides. 























eee 
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Passage d 


One of the most interesting birds which ever lived in my 
bird-room was a blue jay named Jakie. He was full of business 
from morning till night, scarcely ever still. He had been stolen 
from a nest long before he could fly, and he was reared in a 
house, long before he had been given to me as a pet. 


Passage e 


The part of farming enjoyed most by a boy is the making 
of maple-sugar. It is better than blackberrying and almost as 
good as fishing. One reason he likes this work is that some 
one else does most of it. It is a sort of work in which he can 
appear to be very industrious, and yet do but little. 


Passage f 


It was one of those wonderful evenings such as are found 
only in this magnificent region. The sun had sunk behind the 
mountains, but it was still light. The twilight glow embraced 
a third of the sky, and against its brilliancy stood the dull 
white masses of the mountains in evident contrast. 


Passage g 


George Washington was in every sense of the word a wise, 
good and great man. But his temper was naturally irritable 
and high-toned. Through reflection and resolution he had ob- 
tained a firm and habitual ascendancy over it. If, however, it 
broke loose its bonds, he was most tremendous in his wrath. 


Passage h 


Responding to the impulse of habit, Josephus spoke and the 
others listened attentively, but in grim and contemptuous 
silence. He spoke for a long time, continuously, persistently 
and ingratiatingly. Finally exhausted through lack of nourish- 
ment, he hesitated. As always happens in that contingency, 
he was lost. 
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Passage 7 


The hypotheses concerning physical phenomena formulated by 
the early philosophers proved to be inconsistent and, in general, 
not universally applicable. Before relatively accurate principles 
could be established, physicists, mathematicians, and statisti- 
cians had to combine forces and work arduously. 


Passage 7 


“Read the following sentences correctly: Sophistry is falla- 
cious reasoning. They resuscitated him. Verbiage is wordiness. 
Equanimity is evenness of mind. He has a pertinacious, obsti- 
nate disposition. There was subtlety and poignancy in his 
remarks. A hypocritical or pharisaical nature is usually cynical.” 


A pupil is measured by having him read these passages in 
order, stopping at the end of each passage. The measurer counts 
the errors (or records them in detail on a duplicate of the scale, 
following the method below), and also records the time required 
for each passage. For a pupil to make four or more errors and 
take 30 or more seconds, or for him to make five or more errors, 
however quickly he reads, may be used as a convenient standard 
of failure to read the passage. A pupil who does as badly as 
this with any given step of the scale is likely to break down 
very decidedly soon thereafter. 

The method used by Mr. Gray is described by him as follows: 

“The data recorded were of two types. In the first place, 
the number of seconds required to read the paragraphs respec- 
tively was recorded. These data were secured with an ordinary 
watch. A stop-watch was tried but it was found to be no more 
satisfactory than the ordinary watch. The other data recorded 
grouped themselves under the five headings already described: 
namely, gross errors, minor errors, omissions, substitutions and 
insertions. In order to illustrate clearly the character of errors 
considered and the method of recording them the following 
paragraph is inserted: 
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The sun pierded into my targe windows. [t 


ed 


was the opéning of October, and the saky was Gf a 

dazzling blue. I looked: out of the window @aDdown the 
strest. The white house@ of the long, stfaight streets 
were @Jmost painful to the eyés. The clear atmosphere 


allowed full play to the sun's brightness. 


“Gross errors were marked by underlining as in the case 
of ‘atmosphere.’ Minor errors, such as dividing ‘ pierced’ 
into two syllables, leaving the ‘e’ out of ‘ opening,’ sounding 
a in ‘ dazzling,’ omitting the ‘s’ in ‘ houses’ and ‘al’ in ‘ al- 
most,’ omitting the ‘r’ in ‘straight’ and sounding long 6 in 
‘ allowed,’ were appropriately marked. Omissions were marked, 
as in the case of ‘ of’ and ‘ and,’ substitutions as in the case 
of ‘many’ for ‘ my,’ and insertions as in the case of ‘ clear.’”’ * 

That the scale even in its present form is adequate to measure 
differences between classes is shown by its results in the case 
of three groups, the 6B class in School A, the 6B class in School 
B, and a group made up of two sixth-grade classes in School C, 
as measured by Mr. Gray. The percentages succeeding with 
the different paragraphs of the scale (by a somewhat less severe 
standard than that recommended above) were: 


Passage oa b c .. L224 @.° ) 3 
Scholl A 95 100 85 80 50 30 15 10 5 
School B 100 100 97 97 91 88 55 25 3 
School C 100 100 100 100 98 98 92 82 30 


ooo. 


School A has 80% of success at difficulty d; 
School B has 80% of success at a difficulty somewhat above f; and 
School C, at a difficulty of h. 


The assignment of a numerical value to represent the amount 


* Page 17 f. of a dissertation on file in the Library of Teachers College, 
Columbia University, entitled A Tentative Scale for Measuring Oral Read- 
ing, by William S. Gray, 1914. 
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| of difficulty of any one of these passages is at present extremely 
insecure. If such assignment has to be made, the following 
| values will probably serve better than the reader’s own guess: 


Passagea== 4.5 


ee b= 5 

| c= 6 
« d=i7 

- e== 8 

- f{=9.5 

*« g=11 

* h-ei2 

. i= 14 

. j= 15 


The whole matter of exact definition of the relative differ- 
ence between the successive steps of this provisional scale is, 
however, one for study. The order of difficulty is established 
but the amounts—b-a, c-d, d-c, etc.—are as yet unmeasured. 








| 
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Teachers College Record has new plans for 1915 


For a number of years the TEACHERS COLLEGE 
RECORD has been favorably known among the Teachers 
College alumni and other professional educators for its scien- 
tific monographs on important educational topics. These 
monographs have covered all fields of education and have 
often included the first public announcement of experiments, 
methods, and theories found in the best current educational 
practice. It is planned to continue this important feature 
of the RECORD in 1915 and to supplement it by numerous 
shorter articles, written in non-technical style, covering each 
of the departments of educational specialization; thus making 
a much enlarged journal, each number of which will be of 
interest to all subscribers. The new RECORD will give 
attention not only to the fields of educational administration, 
elementary, kindergarten, and secondary education, but also 
to those of household arts, fine arts, nursing and health, and 
household administration. In order to offer every facility 
for treating adequately the departments of household arts, 
the HOUSEHOLD ARTS REVIEW of Teachers College, so 
favorably known for a number of years among students of 
domestic science and domestic art, will cease publication in 
separate form, and commencing with the issue for January 
1915, will be incorporated with the TEACHERS COLLEGE 
RECORD. 

The new RECORD will endeavor to report faithfully to 
alumni all important policies, new educational practices and 
experiments in education in process of development in each 
of the departments of the college. 

There will be news of the alumni and their work, the 
Alumni Association, and the various Teachers College clubs 
now being organized in a number of cities. 














ADVERTISEMENTS 


Dean Russell will continue to edit the Record in its new 
form, thus assuring its success. The staff of contributors 
will include the members of the Teachers College Faculty 
and prominent alumni. The Record will appear bi-monthly, 
except July, as formerly. 

Due to the many added features of the new Record, the 
subscription rate has been increased to $1.50 per year. To 
members of the Teachers College Alumni Association in good 
standing the rate will be one dollar per year. 
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